Skip to content

Conversation

@ZdravkoDonev-redis
Copy link
Collaborator

Reworking our internal Confluence doc for setting up Spanner as official documentation on how RDI works with Spanner.

@CLAassistant
Copy link

CLAassistant commented Aug 18, 2025

CLA assistant check
All committers have signed the CLA.

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR introduces comprehensive documentation for setting up Google Cloud Spanner as a source database for Redis Data Integration (RDI). The documentation covers the complete setup process from database preparation to deployment configuration.

Key changes:

  • Creates detailed setup guide for Spanner CDC configuration and authentication
  • Adds Spanner to the supported source database versions table
  • Provides complete configuration examples for both snapshot and streaming phases

Reviewed Changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.

File Description
content/integrate/redis-data-integration/data-pipelines/prepare-dbs/spanner.md New comprehensive documentation file covering Spanner setup, service account creation, secrets configuration, and RDI pipeline configuration
content/embeds/rdi-supported-source-versions.md Adds Spanner entry to the supported database versions table

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@ZdravkoDonev-redis ZdravkoDonev-redis changed the title RDSC-3972: Initial draft of the Spanner public docs support RDSC-3972: RDI now supports Google Spanner public docs support Aug 18, 2025
@ZdravkoDonev-redis ZdravkoDonev-redis changed the title RDSC-3972: RDI now supports Google Spanner public docs support RDSC-3972: RDI now supports Google Spanner public docs Aug 18, 2025
Copy link
Collaborator

@dwdougherty dwdougherty left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @ZdravkoDonev-redis. I've made a few in-line suggestions, and also some broader changes for you to consider.

appropriate permissions. This service account will then be provided to RDI as a secret for
authentication.

### Step 1: Create the service account
Copy link
Collaborator

@dwdougherty dwdougherty Aug 18, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use a numbered list here instead of "Step 1", "...", which is more consistent with the other docs in related topics. Remember to add four spaces before each line that should be under each step.

@dwdougherty
Copy link
Collaborator

@ZdravkoDonev-redis: please sign the CLA.

Spanner is only supported with RDI deployed on Kubernetes/Helm. RDI VM mode does not support Spanner as a source database.
{{< /note >}}

You must have the necessary privileges to manage the database schema and create service accounts
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is lacking:
The user needs to define a service account with permissions X,Y,Z with which RDI will authenticate to use spanner

Make sure to replace the relevant connection details with your own for both the Spanner and target
Redis databases.

## 6. Additional Kubernetes configuration
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is done during installation IIRC as part of values.yaml
so needs to be added to k8s installation - configure to install when using Spanner as source

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@yaronp68 This is specific to the spanner as we're configuring the flinkCollector. I think here is the correct place?

We could add it to the other doc as well...

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ZdravkoDonev-redis how would the customer discover this when installing? Maybe add a If you plan to use Spanner with this installation of RDI please have a look at link
@dwdougherty FYI

Copy link
Collaborator

@dwdougherty dwdougherty left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Approving.

Make sure to replace the relevant connection details with your own for both the Spanner and target
Redis databases.

## 6. Additional Kubernetes configuration
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ZdravkoDonev-redis how would the customer discover this when installing? Maybe add a If you plan to use Spanner with this installation of RDI please have a look at link
@dwdougherty FYI

@dwdougherty dwdougherty merged commit fe80b22 into main Aug 20, 2025
5 checks passed
@dwdougherty dwdougherty deleted the RDSC-3972-add-spanner-public-docs-support branch August 20, 2025 09:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants